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ABSTRACT 

Sufficient  conditions  for  uniform  integrabilitv  in  the  regenerative 
central  limit  theorem  (CLT)  are  obtained.  The  result  is  used  to  show  the 
equality  of  two  different  representations  for  the  variance  constant 
appearing  in  the  CLT,  as  well  as  to  study  the  asymptotic  moment  structure 
of  the  regenerative  variance  estimator. 
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1.  INTRODUCTION 


Let  X  ■  (x(t)  *  t  O)  be  a  real-valued  stochastic  process 
representing  the  output  of  a  simulation.  (To  incorporate  discrete-time 
sequences  (x^:  n  ^  0)  into  our  framework,  we  set  X(t)  ■  Xjt|,  where 
[ t ]  is  the  greatest  integer  less  than  or  equal  to  t.)  Suppose  that  X 
is  ergodic,  in  the  sense  that  there  exists  |*  «  1R  such  that 


(1.1) 


X(t)  =  j  I  X(s)ds 
0 


-> 


as  t  ♦  •.  Considerable  attention  has  been  focused,  in  the  simulation 
literature,  on  the  problem  of  producing  confidence  intervals  for  the 
estiraand  p;  this  is  known  as  the  steady-state  simulation  problem.  (See 
Chapter  8  of  LAW  and  KELTON  (1983)  for  details.) 

Virtually  all  methods  proposed  for  the  steady-state  simulation  problem 
require  that  X  obey  a  central  limit  theorem;  that  is,  there  should  exist 
a  constant  a  for  which 

(1.2)  t1/2(X(t)  -  4)  «>  0N( 0,1) 


as  t  ®.  Sufficient  conditions  for  (1.2)  are  well-known.  In  particular, 
conditions  for  the  validity  of  (1.2)  are  known  when  X  is  regenerative 
(SMITH  (1955)),  strong  mixing  (HALL  and  HEYDE  (1980),  pp.  127-153), 

^-mixing  (BILLINGSLEY  (1968),  pp.  166-193)  and  associated  (NEWMAN  and 
WRIGHT  (1981)). 

Recently,  several  contributions  to  the  steady-state  simulation  problem 
have  required  a  moment  version  of  (1.2): 


Of  course,  relation  (1.3)  is  a  statement  about  uniform  integrability  in  the 
limit  theorem  obtained  by  taking  the  k**1  power  of  both  sides  of  (1.2). 

In  this  paper,  it  is  our  intention  to  establish  (1.3)  for  the  class  of 
regenerative  processes  satisfying  a  relatively  mild  moment  assumption, 
thereby  showing  that  (1.3)  is  a  condition  which  is  in  force  for  a  large 
class  of  steady-state  simulations.  In  particular,  since  general  state 
space  Markov  chains  can  frequently  be  made  regenerative  (see  ATHREYA  and 
NEY  (1978)),  the  uniform  integrability  result  obtained  here  applies  to  a 
larger  class  of  simulations  than  one  would  initially  expect. 

As  indicated  previously,  (1.3)  is  a  limit  theorem  which  enjoys  a 
number  of  simulation-related  applications: 

(i)  limit  theory  for  the  method  of  replications  (see  GLYNN  (1986)); 

(ii)  efficiency  of  conditional  Monte  Carlo  for  semi-Markov  processes 
(see  FOX  and  GLYNN  (1986)); 

(iii)  large-sample  theory  for  indirect  estimation  via  L  ■  AW  (GLYNN 
and  WHITT  (1986)); 

(iv)  asymptotics  for  control  variates  as  applied  to  steady-state 
simulation  (see  GLYNN  and  IGLEHART  (1986a)); 

(v)  large-sample  theory  for  confidence  intervals  (GLYNN  and  IGLEHART 
(1986b)). 

In  this  paper,  we  shall  also  present  several  additional  applications 
of  uniform  integrability  to  simulation.  Both  applications  concern  the 
constant  o  appearing  in  (1.2);  as  is  well  known,  estimation  of  a  is  the 
central  problem  in  producing  steady-state  confidence  Intervals  for  n. 


\ 


Loosely  speaking,  the  first  application  of  uniform  integrability  involves 
showing  that  o  has  two  different  representations,  corresponding  to 
whether  X  is  viewed  as  a  regenerative  process  or  an  (asymptotically) 
stationary  process.  The  second  topic  concerns  the  asymptotic  variance  of 
the  regenerative  variance  estimator  for  0. 

This  paper  is  organized  as  follows.  Section  2  is  devoted  to  precise 
statements  of  the  main  results  of  this  paper,  while  Sections  3  to  5  con-* 
tain  the  proofs  of  the  results  discussed  in  Section  2. 


2.  STATEMENT  OF  MAIN  RESULTS 

Let  X  *  (X(t):  t  0)  be  a  (possibly)  delayed  real-valued  regenera¬ 
tive  process  with  regeneration  times  0£  T(0)  <  T(l)  <  ...  .  For  convenl 
ence,  set  T(— 1 )  ■  0,  and  let 


T(i) 

Y.  -  /  X(s)ds  , 

T(i-l) 

T(i) 

Y  -  J  |X(s) |ds  ,  and 

T(i-l) 


-  T(i)  -  T(i-l)  . 


Then,  if  E(Y^  +  x^)  <  " ,  it  is  well  known  (see,  for  example  SMITH 
(1955))  that  the  strong  law  version  of  (1.1)  holds,  namely 


X(t)  ♦  p  a.s. 


0  0 

as  t  ♦  «,  where  p  -  EY^/Et^.  If,  furthermore,  E(Yj  +  tp  <  •,  then 
the  central  limit  theorem  (1.2)  is  valid  (see  [18]): 


(2.1) 


t1/2(X(t)  -  p)  ->  ON(0,1) 


2  1/2 

where  a  -  (EZ^/Et^)  and  Z^  -  Our  first  result  gives  con¬ 
ditions  under  which  the  left-hand  side  of  (2.1)  is  moment  uniformly 
lntegrable. 


(2.2)  THEOREM.  For  p  _>  2,  if  E(y£  +  +  tq  +  Tl>  <  "•  then 

{ tp^  |X( t )— ja  |p:  t  >  0)  is  uniformly  lntegrable. 

An  Immediate  corollary  to  this  result  are  conditions  which  allow  one 
to  interchange  limit  and  expectation  in  (2.1). 


(2.3)  COROLLARY.  For  p  >  2,  if  E(Y^  +  +  xq  +  Tj)  <  *,  then 


for  0  <  a  <  p, 


(2.4) 


as  t  ■*  •. 


ta/2E!x(t)-n!a  ♦  o“e!n(0,i) |a 


For  p  *2,  (2.4)  has  been  studied  previously  by  CHUNG  (1966),  p.  102 
(the  proof  given  there  in  the  Markov  chain  case  easily  extends  to  the 
regenerative  setting),  and  by  SMITH  (1955).  Our  result  weakens  the  condi¬ 
tions  given  there  somewhat,  and  extends  the  result  to  p  >  2. 

We  now  turn  to  describing  the  first  of  the  two  applications  mentioned 

in  Section  1.  The  limit  theorem  (2.1)  shows  that  the  constant  o  may  be 
2  2 

computed  via  a  ■  EZ^/Et^.  An  alternative  representation  for  a  may  be 
obtained  by  taking  limits  in  (2.4)  with  p  »  2: 


(2.5) 


tE(X(t)-n)2  ♦  a2 


tw 


4 


as  t  ♦  ".  The  left-hand  side  of  (2.5)  has  a  particularly  convenient  form 
if  X  is  a  stationary  regenerative  process.  If  X  is  stationary  regener 

A  »  A 

ative  under  P,  then  (E(*)  denotes  expectation  relative  to  P) 

-  t 

(2.6)  tE(X( t)-p;  *  2  /  (l-|)  E((X(0)-p)  •  (X(s)-p))ds 

0  C 

Letting  t  ♦  one  would  formally  expect  that 

CO 

o2  »  2  /  E((X(0)-n)(X(s)-*i))ds  . 

0 

Our  first  application  concerns  finding  precise  conditions  under  which 

9 

(2.7)  EZ?/ET  -  2  /  E((X(0)-H)(X(s)-H))ds 

1  0 

A 

where  P  is  the  stationary  version  of  the  regenerative  process  associated 
with  P.  (See  HEYMAN  and  SOBEL  (1982),  pp.  374-379.) 

(2.8)  THEOREM.  Suppose  either  that: 

(i)  Tj  has  a  Lebesgue  density  component  in  its  distribution,  X  is 

3 

bounded ,  and  Ei ^  <  • ,  or 

(ii)  T ^  has  an  aperiodic  distribution  concentrated  on  (l,2,  ...) 
and  E(Yj  +  t*)  <  -. 

Then,  (2.7)  is  valid. 

An  Important  special  case  of  Theorem  2.8  is  obtained  by  specializing 
to  Markov  processes.  Let  T  ■  (Y(t):  t  ^  0}  be  an  irreducible  positive 
recurrent  continuous- time  Markov  chain  on  state  space  S  c  Z+  *  (0,1,2,  .. 


Given  a  bounded  real-valued  function  f  defined  on  S,  set  X(t)  «  f(Y(t)). 
For  fixed  i  c  S,  let  T(0)  -  inf(s  >_  0:  Y(s)  -  i},  T(n)  -  inf{s  >  T(n-l): 
Y(s-)  +  i,  Y(s)“  i)  for  n  ^  1.  The  sequence  (T(n):  n  ^  0)  consti¬ 
tutes  regeneration  times  for  X.  Since  Tj  has  a  density,  Theorem  2.8  (i) 
applies  and  we  get  the  following  corollary. 

(2.9)  COROLLARY.  Suppose  E^T(l)^  <  ®.  Then 

TO) 

(2.10)  E  (J  (f(Y(s))-H)ds)Z/E4T(l)  -  2  /  E(f(Y(0) )-p)(f(Y(s) )-p)ds 

1  0  1  0  11 

where  p  ■  E1{f(X(0))  (the  integral  on  the  right-hand  side  of  (2.10) 
converges  absolutely) . 

Our  second  application  concerns  the  regenerative  estimator  for  the 
constant  a  appearing  in  (2.1).  It  is  well  known  that  if  E(Y2  +  x2)  <  ®, 
then 

X(t)xR)2;  N(t)  >  1 
;  N(t)  >  0 


v(t) 


i  V 

k-1 


<Yk‘ 


2  2 

coverges  to  o  -  EZ^/E't^  a.s.;  the  estimator  for  o  is  then  given  by 

1/2 

s(t)  ■  v(t)  .  To  study  coverage  problems  associated  with  regenerative 
confidence  Intervals,  it  is  of  Interest  to  study  the  correlation  between 
the  point  estimate  X(t)  and  the  standard  deviation  estimate  s(t)  (see, 
for  example,  BRATLEY,  FOX,  and  SCHRAGE  (1983),  p.  113).  A  further 
interesting  point  involves  the  variability  of  s(t)  as  a  function  of  the 


regeneration  state  chosen.  Both  these  questions  require  evaluating  the 
asymptotic  moment  structure  connecting  X(t)  and  s(t). 


To  study  the  asymptotic  moment  structure,  we  use  a  joint  limit 
theorem  for  X(t)  and  s(t);  if  E(Y^  +  r^)  <  «,  then 

(2.11)  t1/2(X(t)-n,  s(t)-o)  ->  N( 0,C) 

where  N(0,C)  is  a  bivariate  normal  r.v.  with  mean  vector  0  and  covari¬ 
ance  matrix  C  given  by 


C 


ET1  \  Uor^EA^j  -  XEZ2) 


(2a)“1(EA1Z1  -  XEzJ) 
(4o2)"1(EA2-2X.EA1Z1  +  \2EZ2) 


where  At  -  Z2  -  d2-^,  X  -  ZEZ^/ETj.  (See  GLYNN  and  IGLEHART  (1986c.) 
The  continuous  mapping  principle,  as  applied  to  (2.11),  yields 


(2.12)  t(s(t)-o)2  -►  C222N(0,1) 

and 


(2.13)  t(X(t)-»i)(s(t)-o)  ->  k(N(0,C) ) 


2 

when  k:  R  1R  is  defined  by  Wx^^)  ■  XjXj.  ^  the  appropriate 
uniform  lntegrabllity  holds,  then  one  can  pass  expectations  through  (2.12) 
and  (2.13),  yielding 

(2.14)  tE(s(t)-<T)2  ♦  (4o2)”1(EA2  -  2XEAJZJ  +  X2EZ2) 

(2.15)  tE(X(t)-p)(s(t)-o)  ♦  (2d)”1 (EA. Z.  -  XEZ?)  . 


In  other  words,  the  covariance  matrix  C  does  legitimately  correspond  to 
the  limiting  covariances  associated  with  X(t)  and  s(t).  This  is  the 
content  of  our  second  application. 

(2.16)  THEOREM.  If  E(Y®  +  Y®  +  T®  +  T®)  <  -,  then  (2.14)  and 
(2.15)  are  valid. 

Empirical  evidence  (see  [11))  indicates  that  the  asymptotic  covariance 

_  i  2 

(2o)  (EAjZj  -  XEZj)  is  independent  of  the  choice  of  the  regeneration 
state.  While  the  asymptotic  variance  of  s(t)  does  depend  on  the  regener¬ 
ation  state,  the  variance  does  not  appear  to  be  minimized  by  choosing  the 
state  with  minimal  expected  inter-regeneration  time.  Both  these  issues 
will  be  studied  theoretically  in  a  future  paper. 

3.  PROOF  OF  THEOREM  2.2 

We  will  show  that  the  collection  of  r.v.'s  A  ■  (tp^2 lx(t)-p |p:  t  >  0} 
is  dominated  by  a  uniformly  lntegrable  family,  thereby  showing  that  A  is 
uniformly  lntegrable. 

Let  N(t)  »  max(k  >_  -1:  T(k)  £  t) ,  and  write 

t  N(t)+2  T(N(t)+2) 

j  X  (s)ds  -  t  Z j  X  (s)ds 

0  C  k-0  t  C 

where  X£(t)  ■  X(t)  -  4.  Then, 

t  N(t)+2  T(N(t)+2) 

(3.1)  |/  X(s)ds|P<(|  J  Z  |  +  [Z  -  /  X  (s)ds  |  )P 

0  c  k-1  U  t  C 

N(t)+2 

-  ^  ^  Zk'  +  U0  +  UN(t)+l  +  UN(t)+2^ 


where  Observe  that  for  non-negative  numbers 

a.(l  <  i  <  k) ,  a.  |p  _<  |k  max  a  |p  -  kp  •  max  aP  £  kP  * 

1  1  1  Ki<k  1  l<i<k 

aP,  and  hence  it  follows  from  (3.1)  that 

<3.2)  t"/2  i*(t)-i»ip  <  rr  3-  up + »p(t)+1 + up(tH2) 

,,  N(t)+2  N(t)+2 

<  4P-t-p/2*(  I  1  !j'i  i  Of). 


k-0 


We  will  now  prove  that  the  right-hand  side  of  (3.2)  is  uniformly  integra- 
ble.  First,  observe  that  since  E(YP  +tp)  <  «*,  it  is  immediate  that 
EUP  <  ®,  and  so  the  strong  law  of  large  numbers  applies,  yielding 


n 


n- 1 

I 

k-0 


Up  EU 
k 


P 

1 


a.s. 


Since 


N(t)/t  ♦  (Etj)  1  a.s.. 


a  simple  argument  proves  that  a.s. 


P  -  2 
p  >  2  . 


The  continuous  mapping  principle  and  converging-together  lemma  (BILLINGSLEY 
(1968),  pp.  25  and  31)  prove  that 


,,  N(t)+2  „  N(t)+2 

(3.3)  t  p/2-(f  t  Z.  (P  -t-  £  UP)  -> 


k-1 


k-0 


oP|N(0,l)|p  +  EUP/Eri ,  p  -  2 
oP|N(0,l)|P  ,  p  >  2. 


By  Corollary  2  (ii)  of  CHOW  et  al.  (1979)  (see  also  JANSON  (1983), 
Theorem  2.3) 


/,  N(t)+2 

t"p/2  •  E(|  l  Z  |P)  >  oPE|N(0,l)|P 
k-1  K 


On  the  other  hand,  Wald’s  identity  applies  to  the  sum  in  the  U^’s,  yielding 


N(t)+2 

E(  l  UP)  -  EUP  +  E(N(t)+2)EUP  . 
k*  0 


The  elementary  renewal  theorem  then  gives 


p  -  2 
p  >  2  . 


Consequently,  the  limit  theorem  (3.3)  also  holds  in  expectation.  Thus, 
Theorem  5. A  of  [2]  shows  that  the  right-hand  side  of  (3.2)  is  uniformly 
integrable,  proving  the  theorem. 


A.  PROOF  OF  THEOREM  2.8 

A 

The  proof  has  two  parts;  we  first  prove  that  (2.5)  is  valid  under  E 
by  appealing  to  Theorem  2.2,  followed  by  showing  that  the  obvious  limit 
relation  is  valid  on  the  right-hand  side  of  (2.6). 

Given  that  X  is  regenerative  under  P,  X  is  stationary  regenerative 

A 

under  P,  where 


(A.  1 ) 


l  ,T(1> 

p{x  «•}-—-  E (/  I(X  o  0  ...  £  *)ds) 

Etl  T(0)  T(0)+S 


(X  o  0  is  the  stochastic  process  (X(t+s):  s  0)).  In  order  to  apply 

«  ~2  ~2  2  2. 

Theorem  2.2,  we  need  to  show  that  E(Yq  +  +  T^)  <  •.  The 


10 


'-1 . . 


distribution  of  Z  from  the  first  cycle  onwards  is  identical  under  both  P 

A 

and  P  and  hence 


— 2  2 

EYj  -  EYj  <  » 

-2  2 

Etj  -  ETj  <  »  . 


Some  care  is  needed  for  the  zero-th  cycle,  however.  From  (4.1),  it  follows 
that 


.  T(  1 )  T(  1 ) 

P(Y  «  •)  -  ttt-  E(J  I(J  IX(u) |du  £  *)ds }  . 
fc  1  T( 0)  T(0)+s 


Hence 


Tfn  t(i) 

EYq  -  -±-  E {/  (/  |X(u)  Idu)2ds>  <  r^-  e(t  Y?}  . 

0  ET1  T( 0)  T(0)+s  EX1  1  1 

~2  1/33  2/3~3 

By  Holder's  inequality,  Et^Yj  E  '  •  E  '  Y^  <  •  by  hypothe¬ 

sis.  A  similar  analysis  shows  that 


-  2  1  ,T(1)  2 

Et£  -  -i-  E{J  (T(l )-s)  as} 

0  ET1  T( 0) 


et; 


3Et, 


~3  3 

proving  that  E(Y^  +  t^)  <  •  suffices  to  guarantee  that 


tE(X(t)-n)2  ♦  o2 


as  t  ♦  ®. 


11 


3 


•h  V 


* 

i 


To  prove  the  validity  of  taking  formal  limits  in  (2.6),  it  is  enough 
to  show  that  the  integrand  on  the  right-hand  side  of  (2.6),  namely 

(l  -  |)  E(Xc(0)Xc(s))  •  I(s  <  t) 

is  absolutely  dominated  by  an  integrable  function.  In  other  words,  we  are 
done  if  we  prove  that 

(4.2)  /  | EX  (0)X  (s)  |ds  <  -  . 

0  C  c 

Now,  the  left-hand  side  of  (4.2)  is  itself  dominated  by 


(4.3)  /  | EX  (0)X  (s)I(T(O)  >  s)  Ids  +  /  |EX  (0)X  (s)I(T(O)  <  s) Ids 

0  C  c  0  c  C 


The  first  integral  In  (4.3)  can  be  bounded  by 


/  E|X  (0)X  (s)  |I(T(0)  >  s)ds  -  E  /  |X  (0)X  (s)  |ds 
0  c  c  0  c  c 


0) 


By  (4.1), 


„  T(0)  T(  1 )  T( 1 ) 

E  /  |X  (0)X  (s)  |ds  ■  E(/  |X(u)|  /  |X  (s )  |d s  du > 

0  C  C  E  1  T(0)  C  T(0)+u  C 

<-A~  E(/  |X  (u)  |du)2 
ET1  T(0)  C 

<  eT7  e(7i  + 


which  is  finite  by  hypothesis.  We  now  turn  to  the  second  term  In  (4.3), 
Observe  that 


12 


.'/.v.v.'.- v.  y-y- 


EX  (0)X  (s)I(T(O)  <  s) 
c  c  — 

s 

-  /  E(X  (O)X  (s)|T<0)  -  u}  P{T(0)  €  du> 

0  C  C 

s 

-  /  E(X  (O)lT(O)  -  u>  EX  (T(0)+s-u)  P{T(0)  €  du) 

0  C 

-  EXc(0)a(s-T(0))I(T(0)  <  s)  , 

where  a(*)  -  EX  (T(0)+*).  Hence,  EX  (O)X  (s)l(T(O)  <  s)  is  absolutely 
c  c  c  — 

dominated  by  E |Xc( 0)a(s-T(0) ) )l(T(0)  <  s).  By  Fubini's  theorem, 

CP 

/  E |X  (O)a(s-T(O) )  |  •  I<T(0)  <  s)ds 
0 

m 

•  E |X  (0) |  •  /  |a(s-T(0)) |ds 

T(0) 

-  E|Xc(0)|  *  P  , 

where  P  ■  /glaCu) |du.  Since  X  is  stationary  under  P,  it  is  evident 
that  E  |Xc(0)  |  <_  E(Y1  +  Hence,  to  complete  the  proof  of  the 

theorem,  we  need  only  show  that  P  <  •  under  our  conditions. 

Clearly,  it  is  sufficient  to  prove  that  EX(T(0)+t)  -  |i  +  0(t  ) 

under  our  hypotheses.  Now,  c(«)  ■  EX(T(0)+*)  satisfies  the  renewal  equa¬ 
tion  c  ■  b  +  c  +  F  where  F(dx)  ■  P(t^  €  dx)  and  b(t)  -  E(x(T(0)+t)  • 
I(tl  >  t)>.  The  solution  of  this  renewal  equation  is  given  by  c  »  b  *  U, 

where  U  •  F^  (F^  Is  the  convolution  of  F).  Conse- 

_2 

quently,  the  question  of  whether  c(t)  ■  n  +  0(t  )  is  equivalent  to  show- 
ing  that  the  rate  of  convergence  of  b  *  U  to  its  limit  I*  is  0(t  ). 
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This  question  has  been  extensively  studied.  If  F  has  a  density  compo¬ 
nent,  a  sufficient  condition  for  this  relation  is  that  (see  NUMMELIN  and 
TUOMINEN  (1983),  Theorem  4.2) 

OB 

(4.4)  /  x2  F(dx)  <  •  . 

0 

A  similar  argument  works  for  discrete-time.  (To  verify  the  conditions  of 
[18],  note  that  if  a  sequence  is  summable,  the  summands  must  converge  to 
zero.  The  continuous  analog  is  incorrect;  this  explains  the  stronger 
hypothesis  in  continuous  time.) 

5.  PROOF  OF  THEOREM  2.15 

We  first  observe  that  (t(X(t)-p)  :  t  >  0)  is  uniformly  integrable 
under  our  conditions.  (Theorem  2.2.)  Note  that 

t(X(t)-P)(s(t)-o)  <  (1/2) (t(X(t)-p)2  +  t(s(t)-o)2]  , 

so  that  the  uniform  integrability  of  (t(X(t)-li)(s(t)-o):  t  >  0)  will 

2 

follow  Immediately  from  uniform  Integrability  of  (t(s(t)-<x)  :  t  >  0)  (see 
p.  100  of  [6]). 

To  obtain  uniform  integrability  of  (t(s(t)-o)  ;  t  >  0),  we  use  the 
following  lemma. 

(5.1)  LEMMA.  For  x  >  0,  ff  >  0,  (x1/2-o)2  <  (4+o‘2) *(x-02)2. 

PROOF.  We  look  at  two  cases:  x^  a2/ 2  and  x  >  o2/2.  If  x£  o2/2, 

then  |x1/2-c|2  <  |0-o|2  -  4(o2/4)  <  4 (x-o2)2.  On  the  other  hand,  if 
2 

x  >  a  / 2,  then  we  use  Taylor's  formula  to  yield 


where  £  lies  beCween  x  and  a  .  Since  x  >  o  / 2,  it  follows  that 
£_1/2  <  2l/2/o  and  hence 


i  1/2  i2  .  1  ,  2 | 

lx  -  a|  <_  —  (x-cr 


for  x  >  cr/2.  The  inequality  follows  immediately  by  combining  the  bounds 
for  the  two  cases. 

The  lemma  shows  that  t(s(t)-o)^  £  (4  +  l/o^)t(v(t)-o2)2.  Our  proof 

2  2 

is  therefore  complete  if  we  prove  that  (t(v(t)-cr  )  :  t  >  0}  is  uniformly 

2 

lntegrable.  We  expand  v(t)  -  o  as 


1  -  1  N(.t) 

•7,1  \  +  2<M-x(t»r  I  Tk 


+  (|i-X(t))' 


.i  T  t 

t  L  k 


-  o4(t-T(N(t)))/t  . 


Thus,  using  the  inequality  (E^la^l)2  <  k2  •  a2  (see  Section  3)  and 

O  J  0  0 

|ab|  <  a  +  b  ,  one  can  bound  t(v(t)-cr;  by 
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